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I. 


INTRODUCTION 


A. BACKGROUND 

The Department of the Navy (DON) adopted the Enterprise Resource Planning 
(ERP) Program as the single system solution to unite all Navy legacy systems, allowing 
for the removal of numerous redundant legacy systems and eliminating nonvalue adding 
practices (Veit, 2005, p. 14). The DON’s budget has seen a steady increase since 1998. 
However, this is predicted to change, and the Navy is expected to operate in a more 
financially constrained environment. Experts predict the Navy’s budget will decrease, if 
the pattern of the last 50 years continues (Brook & Candreva, 2007, pp. 51-53). 

Since the early 1990s, legislative initiatives have been directed at both the 
Department of Defense (DoD) and the DON to improve both the management and 
accountability of their financial operations. The Chief Einancial Officer (CEO) Act of 
1990 sought to institute a new standard for financial management practices within the 
federal government. The creation of a well-planned financial control system was central 
to the success of the CEO Act (General Accounting Office [GAO], 1991, p. 12). 

The external pressure from the DON’s budget and the increased pressure from 
Congress led the Navy to look for a single solution that would standardize its acquisition 
practices, provide reliable and timely financial data (both externally and internally), and 
allow for the management of the Navy’s worldwide assets. Doing all of these things 
would allow senior Navy leadership to make more informed decisions by looking across 
the entire enterprise and seeing the effects of their decisions (Veit, 2005, p. 11). 

This led the Navy to look to a Commercial Off-the-Shelf (COTS) solution for its 
requirement. ERP was the solution put forth by the DON’s Commercial Business 
Practices Working Group (DoNCBPWG). ERP developed from hardware and software 
created in the 1960s and the 1970s. The mainframe computers created in the 1960s 
forever altered business practices. Improvements in hardware offered more power over 
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those of the past and possessed untapped potential. Advancements in hardware led to 
software improvements that tapped into the available hardware’s potential (Monk & 
Wagner, 2009, pp. 20-21). 

Material Requirements Planning (MRP) was the next step along the 
developmental path toward ERP. However, these systems were still compartmentalized 
and did not share information or communicate across departmental boundaries. This 
system grew into Manufacturing Resource Planning (MRP-II) software (Monk & 
Wagner, 2009, p. 21). 

In the early 1990s, ERP programs emerged. ERPs are the result of: 

(1) the advancement of hardware and software technology (computing 
power, memory, and communications) needed to support the system, (2) 
the development of a vision of integrated information systems, and (3) the 
reengineering of companies to shift from a functional focus to a business 
process function. (Monk & Wagner, 2009, p. 19) 

A separate ERP pilot program was initiated at each of the Navy’s four system 
commands (SYSCOMs). ERP proved its usefulness at the SYSCOM level. However, 
having the four separate pilot programs at the SYSCOM level only created four more 
stove-piped systems. In order to achieve the desired goal, in 2003, the DON united all 
four ERPs into one Navy-wide solution managed by one program office. Associated 
legacy systems are being retired as the ERP replacement system is brought online and all 
data have been successfully transferred. The Navy’s ERP system will be the largest 
system deployed to date, when all stages have been released. 

B. PURPOSE 

The primary purpose for developing the ERP system was to coordinate data and 
information across every area of any one business. The DON, like many commercial 
companies, has expended large sums of money implementing its ERP system. The DON, 
like several companies, was not fully successful in its initial attempts at deploying 
equally complex ERP systems. 
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In this project, we examine the DON’s expected return on investment (ROI) from 
its ERP program implementation. A comparison between the DON’s ROI to a successful 
private-sector ROI was done to see if the DON is achieving the same degree of success as 
private companies. 

C. RESEARCH QUESTIONS 

The purpose of this thesis was to provide an understanding of the direct costs and 
benefits incurred while executing the ERP system and to determine the DON’s ROI to 
date of the ERP. 

In this research, we look at the ROI from employing ERP. Eirst, we collected and 
normalized the actual benefits received and actual costs to date so that all financial 
information is in fiscal year (EY) 2010 dollars. Then, we normali z ed the forecasted 
benefits and costs to the same base year. Einally, we calculated two ROIs, one actual and 
one forecasted. Both were calculated because most of the costs to implement an ERP are 
upfront, and most of the benefits are seen over time. 

1. Primary Research Question 

• Has implementing ERP provided the DON with a current positive ROI at 
the end of EYIO? If not, will the ERP provide the DON with a positive 
forecasted ROI by the end of PY15? 

2. Secondary Research Questions 

• How do the actual ROI and the forecasted ROI compare to those of private 
companies? 

• Were there any nonmonetary benefits not considered in the calculation? 

D. THESIS SCOPE 

The focal point of our thesis was the actual ROI the DON received at the end of 
EYIO. Our secondary focus was on the expected ROI the DON will receive at the end of 
EY15. 
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E. METHODOLOGY 


In our research, we did the following: (1) conducted a thorough literature review 
on the origins and evolution of ERP; (2) summarized the history of ERP, as implemented 
by the DON; (3) developed a definition of ROI used on technology projects; 
(4) presented the ROI experienced by several private companies implementing ERP 
systems; (5) collected data from members of the ERP program office; and (6) analyzed 
the cost and benefit data of implementing the DON’s ERP collected by the DON and 
normalized it. 

In the literature review, (1) we created a common definition of what an ERP is 
and the value of implementing it; (2) we provided a brief history of ERP, as implemented 
by the DON; (3) we established a shared understanding of ROI; and (4) we devised a 
yard stick for comparing the DON’s ROI to that of private companies. 

All DON financial cost and benefit data were provided to us in then-year dollars. 
To conduct our analysis, the data needed to be normalized. Converting all financial cost 
and benefit data to a common base year was required. The base year we chose was 2004. 
A base year of 2004 was chosen because it was the beginning of the program. All data 
were normali z ed using the Naval Center for Cost Analysis’s (NCCA) joint inflation 
calculator. The appropriation account we chose was the Other Appropriation Navy 
Account (1810). A then-year to constant-year conversion was done for each. 

There are many tools one can employ to analyze an investment, such as the 
DON’S ERP Program. We chose ROI because this equation allowed us to isolate the 
DON’S ERP Program from potentially confounding factors. Separating the DON’s ERP 
Program allowed an examination of the costs and benefits of the Program, determined 
how well the DON used their scarce resources and compared how the DON measured up 
to similar private industry ERP programs. 

F. ORGANIZATION 

In Chapter II, we include a literature review that provides a summary of what an 
ERP system is and the benefits of implanting such a system. We follow this with a 
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summary of the evolution of ERP in the commercial sector. Next, we examine a brief 
history of the Navy’s attempts to implement ERP. We conclude this chapter with a 
definition of ROI and with the equation we used to determine the Navy’s ROI from its 
ERP system. 

In Chapter III, we present data from each of the SYCOMS for actual and 
projected costs from PY04 to PY15. Then, we introduce the actual and projected benefits 
from PY04 to PY15. We calculate the Navy’s ROI and compare it to commercial-sector 
ROIs. Einally, we examine the primary research question and the secondary questions. 

In Chapter IV, we analyze the data presented in Chapter III. We compare the ROI 
the Navy achieved from PY04 to EYIO and its projected ROI to those the commercial 
sector realized by implementing ERP systems. We compare these two ROIs for two 
reasons: first, to determine how the DON’s ROI compares to that of private firms, and 
second, to make a determination as to whether the DON is doing better or worse than a 
private firm. 

In Chapter V, we give conclusions and recommendations based on our evaluation 
of the data presented. 
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II. LITERATURE REVIEW 


A. WHAT IS ENTERPRISE RESOURCE PLANNING? 

A business process is an accumulation of activities that takes one or more features 
of input and creates an output, such as a report or forecast, which is of value to the 
customer. ERP programs help to administer company-wide business processes by using a 
common database and shared management reporting tools (Monk & Wagner, 2009, p. 1). 
Aladwani (2001) defined ERP as the following: 

The enterprise resource planning (ERP) system is an integrated set of 
programs that provides support for core organizational activities such as 
manufacturing and logistics, finance and accounting, sales and marketing, 
and human resources. An ERP system helps the different parts of the 
organization share data and knowledge, reduce costs, and improve 
management of business processes, (p. 266) 

It aspires to amalgamate all departments and functions across a company into a single 
computer system that can perform and serve all the particular needs of the different 
departments (Baatz, Koch, & Slater, 1999). Each department has its own computer 
system, optimized for the selective ways in which that the department does its work. 
However, ERP combines these systems into a single, merged software program that runs 
from a single database, so that the various departments can more easily communicate and 
share information (Baatz et ah, 1999). 

The integrated software program approach can have a tremendous payback if 
companies successfully integrate all business processes as they install the software (Baatz 
et ah, 1999, p. 1). The tasks involved in performing business functions are automated by 
ERP. With ERP, when a service representative takes an order from a customer, all the 
information necessary to provide a quote to the customer is supplied by the ERP system 
(Baatz et ah, 1999, p. 1). The order process should move quickly through the 
organization, with customers getting their orders faster and with more efficiency than 
before. Sharing data and information between and within functional areas leads to more 
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productive business processes (Monk & Wagner, 2009, p. 4). ERP can apply that benefit 
to other major business processes, such as employee benefits or financial reporting (Baatz 
et ah, 1999, p. 1). 


An ERP system supports the integration of business processes across an 
organization or enterprise (e.g., supply chain, finance, manufacturing/maintenance, 
human resources; Veit, 2005, p. 12). As Eigure 1 displays, the functional areas of a 
business process that are currently supported by stove-piped, government-unique legacy 
systems can be better supported by an integrated ERP solution that crosses the entire 
enterprise (Veit, 2005, p. 12). 


Order 

Manage 

Mimageniait merit 
Reporting l-in<»liCiaiS 


Facilnes _ 

Common 


Data 


Procure 

ment 


Human 

Resources 


M anuf actL 
Operator ring/Maint 


Eigure 1. Integrated Enterprise Resource Planning Solution 

(Prom Veit, 2005, p. 12) 

ERP demands change in business processes through integration; therefore, 
business process reengineering is the key to a successful ERP implementation (Veit, 
2005, p. 12). Business processes need to align with ERP software to be effective. 
Business process reengineering becomes an enterprise-wide effort under ERP. All 
necessary data and information are entered into the system one time and remain available 
to all involved in the business process, thus providing “consistent, complete, relevant, 
timely, and reliable information for decision making” (Veit, 2005, p. 12). Successful 
implementation of ERP systems allows organizations to remove costly existing internal 
business systems and interfaces (especially financial feeder systems) and to support a 
more auditable, manageable processing environment (Veit, 2005, p. 12). Successful 
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system execution seeks to reduce costs and provide a dramatic improvement in business 
information. Figure 2 exhibits the ERP relationships from the viewpoint of the Office of 
Financial Operations under the Office of the Assistant Secretary of the Navy. 
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• The Navy is currently 
turning off legacy 
systems and eliminating 
their maintenance 
expense 

■ Navy ERP implements 
streamlined processes, 
standardized across DON 
to ensure mission 
support 


Utilizing commercial off-the-shelf product and business process reengineering, the ACATl Program 
Office is comprised of subject-matter experts, industry partners, and its customer commands 


Figure 2. ASN-FMC, Office of the Financial Operations ERP Definition 

(Prom Veit, 2010, Slide 2) 


According to Sheldon (2005), high performance in a business requires discipline 
and execution. The disciplines inherent in ERP processes allow enterprises to connect 
customers and top-management decisions all the way through to execution in the supply 
chain and the factory floor (Sheldon, 2005, p. 2). “Well-executed ERP not only starts 
with top management, it is totally dependent on top management” (Sheldon, 2005, p. 2). 

B. HISTORY AND EVOLUTION OF ERP 

In the 1960s, cost minimization became a major focus for manufacturing 
companies that had high-volume production. Computer hardware and software began to 
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develop rapidly and changed the way business was conducted. Over time, computers 
emerged to provide integrated, real-time data for business decision-making because 
computer hardware and software capabilities were doubling every 18 months (Monk & 
Wagner, 2009, p. 19). The introduction of new computerized reorder point (ROP) 
systems fulfilled basic manufacturing planning and control (MPC) obligations of firms 
(Jacobs & Weston, 2007, p. 358). An example of the challenges and concerns facing 
companies was provided by chief internal consultant C. Hotter, manager of the Central 
Industrial Engineering Department at Royal Philips Electronics: 

One of the most difficult problems in this area (the area of operations 
management for assembled products, JP) is the calculation of future 
demand of materials. This can be accomplished by exploding bills-of- 
material or by extrapolation of past demand. Especially in the business-to- 
business companies this is the problem, because of the large numbers of 
parts in the files (approximately 20,000 items), the long lead times and the 
many changes to plans and designs. (Peelers, 2009, p. 58) 

Emphasis on management control and inventory became particularly evident when most 
systems’ software was designed to handle inventory based on traditional inventory 
concepts (Kampf, 2006, p. 1). This led to the establishment of Material Requirements 
Planning (MRP) in the 1970s, the predecessor of ERP. 

The evolution to MRP developed with a joint effort between J. I. Case, a 
manufacturer of tractors and other construction machinery, and IBM (Jacobs & Weston, 
2007, p. 358). The newly created software allowed managers to plan, build, and purchase 
inventory requirements based on finished product requirements, inventories, and 
expected arrivals (Keller et ah, 2006, pp. 1^). It was designed to guarantee that a 
manufacturer had the necessary inventory on hand when it was needed. It gave planners 
and managers more control by allowing them to be actively involved so that they could 
employ time-phased orders instead of reacting to production delays (EMI, 2006, 
pp. 1-4). As of the 1960s, the MRP application software was the most advanced method 
to date for planning and scheduling materials for complex manufactured products 
(ERPandMore.com, 2007; Jacobs & Weston, 2007, p. 358). 
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Initial MRP solutions required large technical staffs to support the mainframe 
computers on which the software ran (Jacobs & Weston, 2007, p. 358). Throughout the 
1970s, companies such as Systemanalyse und Programmentwicklung (SAP), J. D. 
Edwards, Oracle, and Baan Corporation were established. These companies emerged to 
create, produce, and market new standard software for integrated business solutions. As a 
result of their combined labors, the integration between forecasting, master scheduling, 
and procurement became established as the fundamental parts and materials planning 
concept used in management and control (Jacobs & Weston, 2007, p. 358). 

In the 1980s, J. D. Edwards began to center its attention on writing software for 
the IBM System/38. This system had a lower cost than the mainframe computers because 
it offered flexible disk drives with capacities useful for small- and medium-sized 
businesses (Jacobs & Weston, 2007, p. 359). The term MRP was applied to the 
increasingly encompassing business functions, contributing to the use of the phrase 
manufacturing resource planning rather than the phrase material requirements planning 
(Jacobs & Weston, 2007). The change from MRP I to Manufacturing Resource Planning 
II (MRP II) was conceived to recognize the newer systems’ capabilities, and the change 
was designed to integrate business planning, sales, support, and other functions. New 
software programs were created to capitalize on the advances made in software 
technology and to capture the improvements in manufacturing. MRP II improved the 
efficiency of manufacturing enterprises by combining information and manufacturing 
technologies (EMI, 2006, pp. 1-5). It linked different departments (such as engineering, 
finance, personnel management, manufacturing, and marketing) using a computer-based 
simulation model (EMI, 2006, pp. 1-5). Although MRP II tended to unite different 
functions of a company, the functional units are not fully integrated; MRP II cannot truly 
be considered an enterprise-wide system (EMI, 2006, pp. 1-5). 

The 1990s witnessed many companies adopting a new globalization trend. 
Organizations began to look within their structure to see how they could improve their 
business and process flows. Management within large companies wanted to eliminate 
costly inefficiencies in their traditional business practices. The functional business model 
led to top-heavy and overstaffed organizations incapable of reacting quickly to change 
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(Monk & Wagner, 2009, p. 22). The quest for inereased effieieneies prompted the 
Gartner Group to eoin the term enterprise resource planning (ERP). The definition of 
ERP ineluded eriteria for analyzing the extent that software was aetually integrated both 
aeross and within the various funetional silos (Jaeobs & Weston, 2007, p. 361). It was an 
extension of MRP II, with added and enhaneed funetional eapability. The goal for an 
integrated ERP was to replace blocks of information with cross-communication to ensure 
enterprise-wide coherence (EMI, 2006, pp. 1-5). When compared to MRP II, ERP offers 
broad functional coverage with much better capabilities. When combined with product 
enhancements, global support, and technology partners, ERP narrows the gap between 
desired and actual features (EMI, 2006, pp. 1-5). 

The ERP industry was led by companies such as SAP, Baan, J. D. Edwards, 
PeopleSoft, and Oracle. In the late 1990s, these companies led the way for companies to 
move to ERP in order to address potential Y2K issues. As it became clear that the date 
turnover from December 31, 1999, to January 1, 2000, might wreak havoc on some 
information systems, companies searched for ways to consolidate data, and ERP systems 
provided one solution (Monk & Wagner, 2009, p. 25). These patterns of technological 
and operational progression from the past were revealed through the ERP evolution. The 
resulting pattern served as a basis for future trends and projections of this technology 
(Pairat & Jungthirapanich, 2005, p. 288). Eigure 3 represents the development and 
progression of ERP through the years. 
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Eigure 3. ERP Development and Progress Through the Years 

(Prom Sysoptima, 2005) 
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C. NAVY ERP 

The Navy ERP business management system combines the key operational 
components of an organization: supply chain, manufacturing/maintenance, finance, 
procurement, and human resources (Veit, 2005, p. 12). The Navy’s ERP program dates 
back to 1988. The Assistant Secretary of Defense for Acquisition and Technology 
established the DoD’s Commercial Business Practices Working Group in response to 
section 912(d) of the PY98 National Defense Authorization Act (Under Secretary of 
Defense for Acquisition, Technology, and Eogistics [USD(AT&E)], 1998). 

The goal of the working group was to minimize the differences the DoD paid for 
goods and services, compared to the private sector (Under Secretary of Defense for 
Acquisition, Technology, and Eogistics [USD(AT&E)], 1998). The difference was 
minimized by implementing a number of strategies. The working group minimized the 
differences by implementing a number of strategies. One such tactic was to switch from a 
military specification to performance specifications. At this time, the Navy’s Revolution 
in Business Affairs Commercial Business Practices Working Group used industry 
executives to help them search for business efficiencies. Industry executives attributed a 
successful ERP solution to business process re-engineering (Sysoptima, 2005). 

In 1998, the DON authorized a limited production of ERP in four major system 
commands. The Navy ERP program grew from four pilots—which provided the basis for 
the convergence of capabilities into a single Navy solution—to be incrementally 
developed and deployed (Sysoptima, 2005). The pilots tested the application of a 
commercial off-the-shelf (COTS) ERP solution. Each of these pilots focused on different 
segments of ERP: 

• Sigma Naval Air Systems Command (NAVAIR)—integrated financials, 
program management and budgeting, procurement, and human resources; 

• Supply Maintenance Aviation Reengineering Team (SMART)—Naval 
Supply Systems Command (NAVSUP) and NAVAIR—maintenance 
planning and supply support processes, interface to Aviation Depots; 

• Navy Enterprise Maintenance Automated Information System (NEMAIS) 
—Naval Sea Systems Command (NAVSEA) optimized intermediate-level 
maintenance, project systems, workforce management; 
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• Cabrillo—Space and Naval Warfare Command (SPAWAR)—Financial 

Management, Navy Working Capital Fund (NWCF) management. 

(GAO, 2005, p. 13; Veit, 2005 p. 12) 

All four of these limited-scope pilots have proven that the Navy can successfully do 
business in a COTS environment (Veit, 2005, p. 12). The cost of each pilot program is 
shown in Table 1. Some of the successes the pilots experienced were quicker financial 
statement availability and reduction in the total required legacy systems. NAVAIR 
shifted their financial system to Sigma, resulting in the reduction in assessment times and 
reduction in the requisition to orders, which provided significant time and resource 
savings for the Navy (Veit, 2005, p. 13). The next step involved bringing these pilot 
programs together into a standard solution for Navy business management, which will 
produce even greater mission support capabilities and efficiency (Veit, 2005, p. 13). 
Three out of the four pilot programs were retained and offered benefits to the Navy. 
“SMART’S timing versus the Navy ERP planning schedule resulted in its termination; 
however, its functionality has been included in the future converged program” (Veit, 
2005, p. 13). 


Table 1. Navy ERP Pilot Projects (in Millions) (Prom GAO, 2005, p. 13) 


Pilot 

Orsanization 

Initial Start 

Costs thromh 

2004 

Cabrillo 

SPAWAR 

Jun 00 

$67.4 

SMART 

NAVSUP 

Aug 00 

$346.4 

NEMAIS 

NAVSEA 

Jun 00 

$414.6 

SIGMA 

NAVAIR 

May 01 

$215.9 


In 2005, the decision to move forward with one integrated program involved the 
Navy’s plans to merge the four pilots into a single solution. Pigure 4 displays the merger. 
As of September 2004, the Navy estimated that its total investment in these four pilots 
was approximately $1 billion (GAO, 2005). The Navy plans for its ERP programs to 
encompass financial management, intermediate-level maintenance, plant supply, 
wholesale support, and program management and to provide the means for future 
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technology inclusion (Veit, 2005, p. 14). Furthermore, the Navy is continuing its effort to 
reduce legacy systems. Between 2001 and the end of 2011, the Navy plans to retire a total 
of 347 legacy systems. 

_k 


r 

Figure 4. Single ERP Solution As Evolved Erom Pilots 

(Prom Veit, 2005, p. 13) 

Although the Navy’s ERP programs were making progress toward 
implementation, the September 2005 GAO report stated several problems that needed to 
be addressed. Por example, there was not a centralized funding and control of each of the 
four pilots. The GAO saw growth in each of the four areas; however, the areas were 
growing on their own and not in coordination with one another. Purthermore, each of the 
pilot program offices configured its software differently, which caused integration and 
interoperability problems (GAO, 2005, p. 14). These pilot program offices configured the 
COTS software differently from each other in order to efficiently manage their own 
functional area of focus. The differences were allowed, even though the four pilot 
programs had many of the same business functions, such as financial management (GAO, 
2005, p. 14). 

Oversight was another issue that needed to be addressed. Because Navy 
leadership divided its ERP programs into four pilots, it did not assign the efforts as major 
automated information systems acquisitions, which limited departmental oversight 
(GAO, 2005, p. 17). In order for this oversight to take place, mission needs statements 
should be prepared to describe the framework of the relevant business needs. The Naval 
Audit Service was involved with identifying some of these oversights. They noted that 
the four ERP pilots were not assigned as major programs. Purthermore, the program 
managers did not get approval of the required documentation before proceeding to the 

next phase (GAO, 2005, p. 18). The DoD Chief Information Officer (CIO) is responsible 
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for the oversight of major automated information systems. Furthermore, an executive 
office is required for executive management. However, because the pilots were never 
designated as major programs, the oversight was at the command, or organizational level 
for funding of the pilots. Navy ERP officials said that, at the beginning of the pilots, 
investment authority was dispersed throughout the Navy, and there was no overall 
requirement within the Navy to address systems from a centralized Navy enterprise level 
(GAO, 2005, p. 18). 

The Navy, in order to fully integrate all financial processes into its ERP program, 
started to work with the Defense Einance and Accounting Services (DEAS) and other 
process owners throughout the Navy and the OSD. The DON Office of Einancial 
Operations also planned to review testing of its ERP financial software before making a 
final decision on approving the ERP software for use (Veit, 2005, p. 14). Eurthermore, 
the Navy ERP Organizational Change Management team is looking into the ERP 
implementation plans and strategies for incorporating the business process changes. They 
also devised how it will monitor the transition from the old to the new system. Quality 
training associated with helping users understand the new process and the execution of 
each component of the process increases the users’ ability to successfully implement 
change (Veit, 2005, p. 14). 

Eooking ahead, GAO recommended the Secretary of Defense direct the Secretary 
of the Navy to take action. In order to strengthen Navy ERP’s management change and 
control processes, revisions to the Navy’s ERP procedures for controlling system changes 
must be acknowledged by the program office (GAO, 2009, p. 23). Decisions about 
change requests will require a proposed change of life cycle cost impact estimation. The 
cost and schedule impacts of each proposed change in the Navy’s ERP tracking pool 
must be captured. To increase the value of the Navy’s ERP independent verification and 
validation (IV&V), GAO recommended to stop performance of the IV&V function under 
the existing contract and to engage the services of a new IV&V agent that is independent 
from all of the Navy ERP management, development, testing, and development activities 
that it may review (GAO, 2009, p. 23). In addition, reports of events should be directed to 
the oversight officials and program office (GAO, 2009, p. 23). 
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Although the four pilots were under different entities with different functional 
focuses, a pattern of problems emerged that provided the Navy with lessons learned that 
could be used in the future. By not meeting its requirement to reduce stove-piped 
systems, the Navy determined that the best way to move forward was to develop a new 
ERP system. New leadership of a central program office would emerge and lessons 
would be learned from the previous pilot projects. One of the most important lessons 
learned from the earlier pilot experiences was the need for disciplined processes in order 
to identify and manage requirements. An integral part of requirements identification is to 
have the system’s users involved in the process to ensure that the system meets their 
needs (GAO, 2005, pp. 23-24). The current status of the Navy’s ERP will be provided in 
Chapter III. 

D. RETURN ON INVESTMENT (ROI) 

The calculation of ROI shows the monetary benefits of the impact measures 
compared with the cost of the project (Phillips & Pulliam Phillips, 2007, p. 15). The ROI 
value is normally stated in terms of either a benefits/costs ratio, the ROI as a percentage, 
or the payback period (Phillips & Pulliam Phillips, 2007, pp. 15-16). Eooking closer at 
the step-by-step process of calculating ROI, one should consider all objectives before 
concluding with the reporting of data. Eigure 5 displays an ROI process model suggested 
by Phillips and Pulliam Phillips (2007) for organizations to conduct a proper analysis. 
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Figure 5. The ROI Process Model (From Phillips & Pulliam Phillips, 2007, p. 19) 
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Given the level of investment and the time needed to execute ERP systems, many 
companies plunged ahead without making ROI calculations (Stein, 1999, p. 1). Some 
wanted to integrate different business units; others wanted to consolidate redundant 
proprietary systems; and many used ERP systems to help solve their year 2000 problems 
(Stein, 1999, p. 1). Analysts say a successful ERP project can cut the fat out of operating 
costs, generate more accurate demand forecasts, speed up production cycles, and greatly 
enhance customer service (Stein, 1999, p. 1). All of these solutions can save an 
organization millions of dollars in the long run. However, the benefits can be costly. Not 
only do ERP systems take time and money to implement, but also they can disturb a 
company’s culture, generate unnecessary training requirements, and even lead to 
productivity declines and mishandled customer orders that can cost millions (Stein, 1999, 
p. 1). 

Prank O’Nell (2008), at Consona Corporation, identified what makes ERP 
worthwhile and looked at the ROI perspective. ROI allows the manufacturer to know if 
ERP implementation will add value to his company. ERP execution allows manufacturers 
to conveniently manage their businesses with advanced functionality (O’Neil, 2008, 
p. 19). According to O’Neil, (2008, p. 19), a successful ERP investment should provide 
the following: 

• A modem, supportable operating environment with many enhancements 
and improved ease-of-use from the prior system 

• Reduced inventory 

• An improved ability to satisfy customer orders on time 

• The ability to generate custom reports 

• Increased data access 

Mike Donovan, president of an international consulting firm, argued that ROI 
potential is present with ERP. He admitted that ERP must be “driven by the right 
strategic and tactical process improvement objectives, with documented assumptions and 
valid ROI expectations and metrics” (Donovan, n.d., p. I). In order for ROI expectations 
to be met and to become positively measurable, the new processes and ERP must be 
implemented correctly and quickly (Donovan, n.d., p. 1). 
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According to the Dowlatshahi (2005), expected returns may not come as soon as 
desired after ERP implementation is complete. Several businesses chose not to perform 
an ROI analysis for different reasons. Some firms claimed that profitability had nothing 
to do with their reasons for implementing ERP (Dowlatshahi, 2005, p. 3752). Investors 
viewed this as a wise claim because most ERP systems show negative ROI for the first 
five years that they are in service (Dowlatshahi, 2005, p. 3753). After the first five years, 
companies can begin to expect steady returns, but not in the traditional form of revenue. 
Most companies that utilized an ERP system calculated their ROI as a result of expected 
savings in inventory and other costs compared with the total cost of implementation 
(Dowlatshahi, 2005, p. 3753). Effectively performing ERP systems reduced the cost of 
production and shipping, resulting in an average savings of $1.5 million per year 
(Dowlatshahi, 2005, p. 3753). Many companies had a need to replace parts of existing 
systems, a fact that was included in cost savings. Some costs and conversion times 
(included in the ROI calculations) would have been incurred regardless of whether these 
organizations chose to execute an ERP system (Dowlatshahi, 2005, p. 3753). 

Many of the costs of ERP are based on hardware, software, and overall 
installation cost. In Chapter III, we present the cost and benefit data, and in Chapter IV, 
we analyze the data. We then compare the ROI calculation of ERP within the Navy to 
that seen in the private sector. We also analyze and further discuss the measurement of 
tangible and intangible benefits when looking at the returns of ERP. We formulate cost 
avoidance, cost savings, inventory savings, and implementation costs to determine if 
there are any current savings with ERP or if a positive ROI can be forecasted through 
2015. 
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III. DATA PRESENTATION 


A. INITIAL AND REVISED ERP COST AND SCHEDULE 

The Assistant Secretary of the Navy for Research, Development, and Acquisition 
directed the merger of the four pilot programs in July 2003. Integrating the four programs 
captured all the functionality of the stove-piped programs into one Navy program. The 
proposed benefit of the merger was to “standardize the Navy’s acquisition, financial, 
program management, plant and wholesale supply, and workforce management business 
processes across its dispersed organizational components, and support about 86,000 users 
when fully implemented” (GAO, September 2009, p. 3). 

The Navy ERP Program office plans to release its ERP program in increments 
called templates. Each template is further broken down into releases. Template 1— 
presently, the only funded template—is broken into three releases. Releases 1.0, 1.1, and 
1.2 are the three releases under Template 1. Release 1.0 is the largest release of the first 
template, incorporating financial management and acquisition. The purpose and design of 
1.0 is to give Echelon II and Echelon III commands the information and data required to 
achieve their financial management and procurement functions. Release 1.0 is grouped 
into four categories: financial management—the General Eund & Navy Working Capital 
Eund, procurement, work force management, and program/project management (Veit, 
2010, Slide 3). 

Release 1.1 incorporates wholesale and retail supply. This solution was created to 
assist and support the Navy’s Single Supply Solution, and become the primary program 
for repairables and consumables. The principal inventory manager for the NWCE will be 
NAVICP by regulating allowances and balancing budgets. The five supply chain 
management processes include the following: planning, allowances, procurement, repair 
of repairables, and order fulfillment (Veit, 2010, Slide 3). Release 1.2 integrates 
intermediate-level maintenance. Table 2 provides further detail on the specifics of each 
release. 
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Table 2. Description of Functionality Added by Template I’s Releases 

(From GAO, 2009, p. 4) 


Release 

Functionality 

1.0 Financial and Acquisition 

- General Fund and Navy Working Capital Fund finance applicatiens, 
such as billing, budgeting, and cost planning. 

- Acquisition applications, such as activity-based costing, contract 
awards, and budget exhibits. 

- Werkforce management applications, such as personnel 
administratien and training, as well as events management. 

1.1 Wholesale and Retail Supply 

- Whelesale applications, such as supply and demand planning, order 
fulfillment, and supply forecasting. 

- Retail supply applicatiens, such as inventory management, supply 
and demand precessing, and warehouse management. 

1.2 Intermediate-Level 

Maintenance 

- Maintenance applications, such as maintenance management, 
quality management, and calibration management. 


The program office, in 2005, expected its ERP system to be fully operational in 
FY11. At this same time, the total cost of the system for its anticipated 20-year life cycle 
was $1.87 billion, and was expected to manage a projected 80% of the Navy’s 
appropriated funds. The percent of appropriated funds was determined after the Marine 
Corps’ funding and military personnel and pay were removed (GAO, 2005). 

The above estimates were revised. In 2007, the ERP Program had slipped behind 
schedule two years and was now expected to be fully operational in PY13. The total cost 
of the system was now estimated to be $2.4 billion over its useful life (2004-2023), an 
increase of roughly 30%. The percentage of the Navy’s appropriated funds managed 
when fully operational has also been revised, which is currently expected to be 50%. The 
Marine Corps’ funding and military personnel and pay were removed prior to this 
estimate (GAO, 2009). 

B. CURRENT HISTORY OF ERP 

Figure 6 depicts the deployment plan for the DON’s ERP Program. Release 1.0 
was implemented in three phases. NAVAIR deployed ERP Release 1.0 in October 2007. 
A total of 15,000 users were included by this release. A geographically diverse command, 
NAVAIR is spread out over four states and two countries. In May 2008, ERP achieved 
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Initial Operational Capability (IOC) at NAVAIR. The IOC was 22 months behind the 
2004 sehedule and four months later than the new 2007 plan. Data eonversion and 
institutionalizing new business proeesses were two main reasons the IOC was delayed. 
The above delays had a ripple effeet on the seheduled deployment of follow-on phases 
(GAO, 2009). 


Background 2003: ASN 

1990: (RDM) directi 

Chief Financidi convergence 
Offtcets (CFO) Actof pilots 


Program of Record 
Milestone Milestone Initial Operating Full Deployment Full Oeploymeni 
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Figure 6. ERP Deployment Timeline (Carter, 2010, Slide 3) 


As part of the same phase, the Defense Finance and Accounting Service (DFAS) 
received Release 1.0 in the same month. The DFAS is less geographically diverse, as it is 
located in two Ohio towns. The DFAS release added 350 users, bringing the total number 
of users to 15,350. In October 2008, Release 1.0 was deployed at NAVSUP, adding 9,500 
users. As of October 2008, the total number of users was 24,850. Release 1.0 was 
implemented at SPAWAR 18 months behind schedule in October 2009. SPAWAR 
brought in 9,265 users, bringing the total to 34,115. The final phase of Release 1.0 was 
deployed at NAVSEA’s General Eund in October 2010 and its Working Capital Eund 
(WCE) planned for October 2011 deployment. The General Eund added 7,667 users. 
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while the WCF added 22,382. These two additions brought the total number of users to 
64,164. Both of these releases were 12 months behind schedule (Veit, 2010). 

Currently, Release 1.1’s implementation plan has been achieved over a period of 
one year, in three phases. Material Group 1 was put into service in March 2010, followed 
by Material Group 2 in August 2010, and ended with Material Group 3 in February 2011. 
No new users were added by this release because they had been included in Release 1.0. 
Release 1.1 is currently being implemented at the DON’s Fleet and Industrial Supply 
Centers (FISCs). This portion of Release 1.1 is planned to take 17 months. Release 1.2, 
for intermediate-level maintenance, was removed and may be added at a later date. 

C. ERP COST AND BENEFIT DATA 

A few definitions will make the data that follow more understandable. For the 
purpose of this study we will use the following definitions. The Secretary of the Navy is 
currently updating the instruction that defines cost savings and cost avoidance. Once the 
updated instruction is signed, cost savings will be defined “as an actual reduction in the 
number of dollars needed to meet a customer requirement by improving a process or 
function. Dollars can be removed from a Budget Line Item (BLI)” (SECNAVINST, 
2007). Cost avoidance will be defined “as a reduction in the number of dollars needed to 
meet a customer requirement by improving a process or function. Dollars cannot be 
removed from a BLI because they have been previously removed or do not exist in the 
budget. Cost avoidances can also result from process improvements that prevent a future 
or unbudgeted cost” (SECNAVINST, 2007). So, for instance, when NAVAIR 
implemented SIGMA, it retired all of its legacy financial management systems. By 
retiring these legacy systems, NAVAIR generated both cost savings and cost avoidance 
by not having to pay for these systems now and in the future. 

The cost data presented in Tables 3 and 4 were received from Herren Associates, 
the company contracted by the Office of the Chief of Naval Operations (OPNAV) and the 
Deputy Chiefs of Naval Operations for Elect Readiness and Logistics (N4) to collect 
current and projected costs for deploying ERP. Herren Associates specializes in 
providing systems acquisition, program analysis, cost engineering, and transformation. 
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The ERP program’s deployment costs are fully funded and include the following: 
Deployment Management Support, Training Delivery Support, User Management 
Support, On-Site Support (OSS), Navy ERP Train-the-Trainer Instructors, Business 
Process Team Support, and Data Management Support (Carter, 2010, Slide 14). The data 
presented in Eigures 3 and 4 display the total actual and projected costs from EY04 to 
EY15. The data are normali z ed so all dollars are presented in base year EY04 dollars. 
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Table 3. Actual ERP Deployment Costs (From Herren Associates, personal communication, January 12, 2011) 


In $K 

FY04 

FY05 

FY06 

FY07 

FY08 

FY09 

FYIO 

Total Cost 

In fiscal year 
indicated 

$44,319 

$65,888 

$115,283 

$173,122 

$202,523 

$221,743 

$207,033 


Normalization 

Factor 

1.0 

.9728 

.9435 

.9187 

.8972 

.8839 

.8769 


In FY04 $ 

$44,319 

$64,093.4 

$108,771.1 

$159,048.7 

$181,698.8 

$196,002.5 

$181,547.7 

$935,481.2 


Table 4. Projected ERP Deployment Costs (From Herren Associates, personal communication, January 12, 2011) 


In $K 

FYII 

FYI2 

FYI3 

FYI4 

FYI5 

Total Cost 

In fiscal year 
indicated 

$214,574 

$131,468 

$92,043 

$76,042 

$71,977 


Normalization 

Factor 

.8656 

.8537 

.8403 

.8262 

.8124 


In FY04 $ 

$185,735.3 

$112,234.2 

$77,343.7 

$62,825.9 

$58,474.1 

$496,613.2 
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The benefit data presented in Tables 5-10 were received from two sources. The 
data in Tables 5-8 were received from the Office of the Assistant Secretary of the Navy 
(Financial Management and Comptroller), Office of Financial Operations. The data in 
Tables 9-10 were received from LMI, a private research institute. LMI was hired by 
OPNAV N4 to conduct a study on the DON’s ERP. Tables 5-7 identify the cost savings 
and avoidance benefits of legacy systems in both actual and projected numbers. All data 
have been normalized into FY04 dollars. Table 8 represents the projected cost savings 
benefits of standardizing inventories. Lastly, Tables 9 and 10 recognize the actual and 
projected cost savings from the benefits of labor. 


Table 5. Projected Cost Savings From Legacy System Retirement 
(Lrom Ingram & Jordan, 2010 Slide 8) 


In$K 

LYI2 

LYI3 

LYI4 

LYI5 

Total 

Benefit 

In fiscal year 
indicated 

$47,400 

$47,400 

$63,700 

$63,700 


Normalization 

Lactor 

.8537 

.8406 

.8262 

.8124 


In LY04 $ 

$40,465.4 

$39,844.4 

$52,628.9 

$51,749.9 

$184,688.6 


Note. There were no cost savings in LY11. 


Table 6. Actual Cost Avoidance Lrom Legacy System Retirement 
(Lrom Ingram & Jordan, 2010 Slide 7) 


In $K 

LY08 

LY09 

LYIO 

Total 

Benefit 

In fiscal year 
indicated 

$18,500 

$43,800 

$53,700 


Normalization 

Lactor 

.8972 

.8839 

.8769 


In LY04 $ 

$16,597.8 

$38,715.6 

$47,089.7 

$102,403.1 
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Table 7. Projected Cost Avoidance From Legacy System Retirement (From Ingram & Jordan, 2010 Slide 7) 


In $K 

FYII 

FYI2 

FYI3 

FYI4 

FYI5 

Total 

Benefit 

In fiscal year 
indicated 

$65,500 

$91,100 

$100,800 

$102,800 

$103,100 


Normalization 

Factor 

.8656 

.8537 

.8403 

.8262 

.8124 


In FY04 $ 

$56,700 

$77,771.8 

$84,697.5 

$84,934.1 

$83,758.1 

$387,861.5 


Table 8. Projected Inventory Cost Savings (From Ingram & Jordan, 2010 Slide 9) 


In$K 

FYI3 

FYI4 

FYI5 

Total 

Benefit 

In fiscal year 
indicated 

$10,000 

$38,000 

$76,000 


Normalization 

Factor 

.8403 

.8262 

.8124 


In FY04 $ 

8,402.5 

31,395.9 

$61,742.2 

$101,540.6 
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Table 9. Actual Labor Savings (From Keller et al., 2006, pp. 6-15) 


In$K 

FYIO 

Total Benefit 

In fiscal year indicated 

$49,000 


Normalization Factor 

.8769 


In FY04 $ 

$42,968.2 

$42,968.2 


Table 10. Projected Labor Savings (From Keller et al., 2006, pp. 6-15) 


In $K 

FYII 

FYI2 

FYI3 

FYI4 

FYI5 

Total 

Benefit 

In fiscal year 
indicated 

$166,000 

$181,000 

$186,000 

$219,000 

$265,000 


Normalization 

Factor 

.8656 

.8537 

.8403 

.8262 

.8124 


In FY04 $ 

$143,697.7 

$154,519.2 

156,287.1 

$180,939.5 

$215,285.2 

$850,728.7 
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Figures 7 and 8 represent the costs and benefits of deploying ERP. These costs (in 
thousands) differentiate between actual and projected figures. 
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Figure 7. 


Total Deployment Costs (Actual and Projected) (From Herren Associates, 
Economic Analysis, January 12, 2011) 


The ROI is closely looked at in Figures 8-13. We analyzed the total costs versus 
benefits (actual and projected). Using the ROI calculations, which will be explained in 
further detail in Chapter IV, we identified the ROI experienced by implementing the 
DON’S ERP Program and compared them to those ROIs experienced by private firms 
that implemented ERP Programs. 
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Total Actual Costs and Total Actual Benefits 
FY04-FY10 
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Figure 8. Actual Costs and Benefits FY04-FY10 (From Herren Associates, Economic 
Analysis, January 12, 2011; Ingram & Jordan 2010, Slides 7-9; Keller et al., 

2006, pp. 6-15) 
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Figure 9. Projected Costs and Benefits FY11-FY15 (From Herren Associates, Economic 
Analysis, January 12, 2011; Ingram & Jordan, 2010 Slides 7-9; Keller et al., 

2006, pp. 6-15) 
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Total Costs and Benefits From FY04-FY15 
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Figure 10. Total Costs and Benefits FY04-FY15 (From Herren Associates, Economic 
Analysis, January 12, 2011; Ingram & Jordan 2010 Slides 7-9; 
Keller et al., 2006, pp. 6-15) 
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Figure 11. Benefit by Savings Category (From Ingram & Jordan, 2010, Slides 7-9) 
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In FY04 $K 



Figure 12. Actual and Projected Benefit Achieved by Each SYSCOM (From Ingram & Jordan, 2010 Slides 7-9) 
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Figure 13. Total Costs (Actual and Projected) vs. Total Benefits (Actual and Projected) (From Herren Associates, Economic Analysis, 

January 12, 2011; Ingram & Jordan, 2010 Slides 7-9) 
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IV. ANALYSIS 


A. INTRODUCTION 

This chapter provides an analysis of the DON’s ERP Program from the data 
presented in Chapter 11. As diseussed in the previous ehapters, the ERP program began in 
PY04 and was first implemented at NAVAIR in October 2007. The DON’s ERP Program 
has not completed its life eyele. As a result, not all costs and benefits are known. Aetual 
costs are known for PY04 to EYIO. The DON, with the help of Herren Assoeiates, has 
developed a projected cost for deploying and maintaining the DON’s ERP Program. 

The same is true for the benefits. Only aetual benefits are known for PY04 to 
EYIO. The DON, with the help of EMI, developed projeeted benefits from implementing 
the DON’S ERP program from EYll to PY15. Benefits are derived from one of three 
sources: the retirement of legacy systems, reduction in the required inventory held by the 
DON, and labor reductions. The legacy system retirement savings is the most aceurate 
estimate, as it is based on known eosts. 

There is more risk in assessing the inventory and labor savings. The DON, with 
the help of Deloitte Consulting, benehmarked 10 aerospaee and defense eompanies that 
employed an ERP system. They found that these eompanies had experienced a 15-20% 
savings in required inventory. Based on this benchmarking, the DON estimated a 
reduction in inventory that equated to 7.5% of its procurement dollars. The DON also 
estimated that the reduction in required inventory would also lead to a 2.5% reduction in 
inventory carrying costs. EMI rated the DON’s inventory savings estimate as reasonable 
(Keller et ah, 2006). 

The labor benefits calculation is a little more complex than the inventory savings. 
Eirst, the DON analyzed industry labor savings. Industry realized a reduetion in labor 
requirements of 5% to 18% by implementing an ERP. The low end of 5% was seen in 
personnel funetions. The high end of 18% was observed in the finaneial seetor. The 
financial sector included financial accounting, cost controlling, and asset accounting. The 
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DON chose the low end of 5%. These improvements did not occur immediately upon 
implementing an ERP. Instead, the improvements were seen over time (Keller et al., 
2006). 

As a result of the time required to see the improvements, the DON developed a 
ramp to calculate the labor savings. A different ramp was applied to each functional area 
impacted by the DON’s ERP. EMI found the ramp used by the Navy to be too optimistic. 
The ramp should have been a little flatter and increased at a slower rate. Although there 
may be a reduction in required labor, it does not mean the DON will immediately 
separate personnel. However, the fact that actual labor savings were seen in EYIO leads 
one to believe that, in the future, the DON will act similarly and reduce the labor force 
(Keller et al., 2006). 

B. CHART ANALYSIS 

1. Deployment Costs 

Eigure 7 depicts the DON’s ERP Program deployment costs. The costs indicated 
from PY04 to EYIO are the actual costs the program obligated. The costs indicated from 
EYll to EY15 are projections for the Program’s expected requirements. One can see 
from this chart that the Program’s costs ramp up from its outset to EYll. ERP’s single 
largest appropriation from EY04 to EY07 is research, development, test, and evaluation 
(RDT&E). RDT&E is the biggest appropriation during this time frame due to the fact that 
the COTS software needs to be modified to meet the needs of the DON. Erom EY08 to 
EYll, the largest appropriation is Operation, and Maintenance Navy (OM&N). OM&N 
replaced RDT&E as the largest appropriation due to the fact that the system was being 
deployed during these years. 

2. Costs and Benefits 

Eigures 8-10 depict the costs and benefits of the Program. Eigure 8 depicts the 
actual costs and benefits from EY04 to EYIO, while Eigure 9 shows projected costs and 
benefits from EYll to EY15. Eigure 10 is a combination of the previous two figures and 
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shows the total costs FY04 to FY15 (actual and projected) and total benefits FY04 to 
FY15 (actual and projected). Comparing Figure 8, the total actual costs FY04 to FYIO, to 
Figure 10, the total costs FY04 to FY15, reveals that the Program’s costs during the first 
seven years is 65.3% of all costs over this entire time frame. The benefits are the exact 
opposite. Comparing the same two figures reveals that 87.0% of all benefits are expected 
to be achieved from FYll to FY15. An accurate ROI calculation can be performed on 
each individual time period. However, an ERP system requires time to recoup the cost of 
implementation, and the DON’s ERP Program has not yet reached full operational 
capabilities. To achieve a fair ROI, one must look at the ERP Program over a longer 
period of time. 


3. Benefits by Savings Category 

Eigure 11 portrays the cost savings/avoidance by the four categories. The 
projected labor savings is the single biggest category. The DON and EMI predict roughly 
3,451 full-time equivalent (ETE) employees will be separated. The 3,451 ETE breaks 
down to 2,569 civilians, 862 contractors, and 20 military personnel (Keller et al., 2006). 
The second biggest category of savings is legacy systems retirement cost avoidance. 
ERP is predicted to retire 347 systems (Veit, 2005). 

4. Benefits by SYSCOM 

Eigure 12 renders the benefits achieved by each SYSCOM. If the projections hold 
true, then the Navy Supply Systems Command (NAVSUP) will have achieved 68.2% of 
the total benefits from EY04 to EY15. This should not be surprising, given they are the 
only SYSCOM with a projected inventory savings, and that 296 of the 347 systems 
expected to be retired by the DON’s ERP Program are either acquisition, financial 
management, or logistics. NAVSUP is the SYSCOM responsible for these systems and, 
therefore, takes credit for these savings/avoidances. 
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C. RETURN ON INVESTMENT CALCULATION 

Our research performed three ROI calculations. The first is based on actual costs 
and benefits. The second uses projected costs and benefits. The third is a compilation of 
the first two, total costs (actual and projected) and total benefits (actual and projected). 

1. Return on Investment Using Actual Cost and Benefit Data 

ROI (actual) = {[legacy system retirement cost avoidance benefits 
(FY08 to FYIO) + labor cost savings benefit (FYIO)] - costs (FY04 to 
FYIO)} / costs (FY04 to FYIO) X 100 

ROI (actual) = {[$102,403,100 + $42,968,200] - $935,481,200} / 
$935,481,200 

ROI (actual) = $-790,109,900 / $935,481,200 X 100 
ROI (actual) = -0.8446 X 100 
ROI (actual) = -84.46 

2. Return on Investment Using Projected Cost and Benefit Data 

ROI (projected) = [[legacy system retirement savings benefits (FY12 
to FY15) -I- legacy system retirement cost avoidance benefits (FY11 to 
FY15) -I- inventory cost savings benefit (FY13 to FY15) -i- labor cost 
savings benefit (FYll to FY15)] - costs (FYll to FY15)} / costs 
(FYll to FY15)X 100 

ROI (projected) = [[$184,688,600 -i- $387,861,500 -i- $101,540,600 -i- 
$850,728,700] - $494,613,200] / $494,613,200 X 100 
ROI (projected) = $1,030,206,200 / $494,613,200 X 100 
ROI (projected) = 2.0829 X 100 
ROI (projected) = 208.29 
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3. 


Return on Investment Using Total Cost and Benefit Data 


ROI (total) = {[legacy system retirement savings benefits (FY12 to 
FY15) + actual legacy system retirement cost avoidance benefits 
(FY08 to FYIO) + projected legacy system retirement cost avoidance 
benefits (FYll to FY15) + inventory cost savings benefit (FY13 to 
FY15) + actual labor cost savings benefit (FYIO) + projected labor 
cost savings benefit (FYll to FY15)] - (actual costs (FY04 to FYIO) 

+ projected costs (FY11 to FY15))} / actual costs (FY04 to FY10) + 

projected costs (FY 11 to FY15) X 100 

ROI (total) = {[$184,688,600 + $102,403,100 + $387,861,500 + 

$101,540,600 + $42,968,200 + $850,728,700] - ($935,481,200 + 

$494,613,200 )} / $935,481,200 + $494,613,200 X 100 

ROI (total) = [$240,096,300 / $1,432,094,400] X 100 

ROI (total) = 0.1677 X 100 

ROI (total) = 16.77 

D. ANALYSIS OF RETURN ON INVESTMENT CALCULATION 

Our intent was to compare the ROI achieved by the DON’s ERP Program with the 
ROI private sector firms realized by implementing ERPs. However, an exhaustive search 
failed to uncover sufficient private sector ERP-specific ROI data to make the desired 
direct comparison. Therefore, in an attempt to present a suitable proxy for comparison, 
we reference a study by Hunton, Eippincott, and Reck, which compared the overall 
financial performance of companies that adopted ERP to the overall financial 
performance of companies that did not adopt ERP. 

The Hunton et al. study looked at four measures of a firm’s performance: return 
on assets, return on sales, asset turnover and ROI. The authors define ROI as “income 
before extraordinary items (available for common stockholders), divided by the sum of 
total long-term debt, preferred stock, minority interest and total common equity. 
Compustat then multiplies the ratio by 100” (Hunton et al., 2003, p. 176). 
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The actual ROI for the Navy’s ERP Program from FY04 to FYIO is -84.46; the 
projected ROI for the Navy’s ERP Program from FYll to FY15 is 208.29; and the 
combined ROI for the Navy’s ERP Program from FY04 to FYI5 is 16.77. All of the 
Navy’s ROIs, with the exception of the actual, are better than those seen in the private 
sector. 

Hunton, Eippincott, and Reck (2003) conducted a study of 126 companies, 
representing 23 different industries. The companies ranged in size from small to large. 
ERP adaptors included 63 companies, while nonadaptors included 63 companies. The 
average total asset for the 63 ERP adopting businesses was $10,861,000, the median was 
$3,654,000, and the standard deviation was $17,448,000. For the 63 non-adopting ERP 
firms, the average total assets were $9,195,000, the median was $3,003,000, and the 
standard deviation was $13,161,000 (Hunton et al., 2003, p. 176). 

Their study followed the 126 companies over four time periods. The first period is 
an average of the three years prior to adopting the ERP system. The second is one year 
after adoption; the third is two years after adoption; and the final is three years after 
adoption. 

Hunton, Eippincott, and Reck studied firms that had adopted ERPs and firms that 
had not. For the 63 firms that adopted ERP systems, there was no significant change in 
ROI over the six years of the study. The average ROI for the three years prior to ERP 
adoption was 8.576 and the median was 8.614. One year after adoption of the ERP 
system, the average dropped to 7.691 and the median went to 8.957. Two years after 
adoption of the ERP system, the average dropped to 7.533 and the median went to 8.411. 
In the last period, the average ROI for ERP adopters increased to 8.002 and the median 
rose to 8.395 (Hunton et al., 2003, p. 177). 

For the 63 firms that had not adopted ERP systems, there was a significant change 
in ROI. The average ROI for the three years prior to non-ERP adoption was 8.498 and the 
median was 7.861. One year after not adopting an ERP system, the average dropped to 
5.804 and the median went to 5.462. Two years after not adopting an ERP system, the 
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average dropped to 4.649 and the median went to 5.153. In the last period, the average 
ROI for non-ERP adopters increased to 5.457 and the median rose to 5.731 (Hunton et 
ah, p. 177). 

Table 11. ROI Performance Comparison Between ERP Adopters and 
Non-ERP Adopters (Hunton et ah, p. 177). 



Pre- 

Adoption 

Post 1 

Year 

Post 2 
Years 

Post 3 

Years 

ERP Adopters 

8.579 

7.691 

7.533 

8.002 

Non-ERP 

Adopters 

8.498 

5.804 

4.649 

5.457 


The above study leads to the following conclusions: (a) One may not see the 
results of implementing an ERP system for several years; (b) Coordination of new 
methods and control functions may be one reason it takes several years to see the results; 
and (c). Their study also lends credibility to the fact that there are efficiencies to be 
gained by implementing an ERP system. However, once implemented and employees are 
fully trained, the ERP system has a positive impact on a firm’s ability to utilize its assets 
(Hunton et ah, 2003, p. 177). 

E. LIMITATIONS OF ROI CALCULATION 

When looking at the gains involved in an ERP process, it becomes difficult to 
factor in these intangible assets. Intangible can be defined as “an identifiable 
nonmonetary asset without physical substance held for use in the production or supply of 
goods or services, for rental to others or for administrative purposes” according to the 
new International Accounting Standard (Murphy & Simon, 2002, p. 303). Tangible assets 
differ in definition as a value is applied in a monetary approach. If a price is able to be 
placed on an object, function, or benefit, then it can be labeled as tangible. In the IT 
industry, intangibles can be broken down into ongoing and future benefits. Ongoing 
would be the more tangible of the two, dealing with internal improvement of an 
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organization. The customer service is the toughest to measure, as it deals with customer 
satisfaction and sales volumes (Murphy & Simon, 2002, p. 304). Figure 14 breaks down 
the intangible benefits and what they mean to the IT industry. 



Increasing Difficulty of Measurement 



Figure 14. Intangible Benefits (Murphy & Simon, 2002, p. 306) 

In 1998, a survey was taken of 62 Fortune 500 companies by Benchmarking 
Partners, Inc. for Deloitte Consulting LLC. In interviews with client firms, the question 
was asked which tangible and intangible benefits were realized in their ERP process. 
Figure 15 displays the outcome and percentages of these intangible benefits. In this 
survey, the categories that classify an intangible asset include: information visibility, new 
improved processes, customer responsiveness, integration, standardization, cost 
reduction, flexibility, globalization, Y2K, business performance, and supply/demand 
chain performance improvement. 
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Figure 15. Intangible Benefits Realized (From O’Leary, 2004, p. 65) 

In a measure of intangible anticipated versus achieved benefits, the achieved 
benefits do not match what is anticipated (Norback & Akerblom, 2003, p. 23). In our 
research, it was found that placing a price tag on intangible returns and benefits is a 
difficult task. Many nonmonetary benefits can correlate to hard numbers if those 
analyzing the numbers can do some “imaginative number-crunching” (Fryer, 1999, 

p. 88). 

The ROI calculation is an excellent tool for analyzing whether a company should 
or should not make an investment. It is not a perfect tool, however. Since ROI is an 
imperfect analytical tool, one should know its limitations. The ROI calculation does not 
include any nonmonetary or intangible elements. There are many nonmonetary elements 
that are not accounted for by the above ROI calculation. These nonmonetary elements 
need to be considered along with the ROI calculation and should inform one’s decision. 

This project received its data from the ERP Program Management Team and from 
contractors they hired. No attempt was made to independently verify the data that were 
received. The authors believe the data fairly represent the cost and benefits associated 
with the DON’S ERP Program. The data provided are the only data known to be 
available. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. SUMMARY 

There is a tremendous cost associated with trying to implement ERP within an 
organization. ERP was first developed by private industries. The DON did not begin 
looking at ERP until the late 1980s, as it began learning from commercial business 
practices. The approximately $2 billion spent by the DON was intended to save mi llions 
of dollars from PY04-PY15. Although the evolution of ERP and development within the 
DON has met its many challenges, analyzing the return on investment involved with its 
implementation could potentially save billions of dollars over the life of the program.. By 
making efforts to coordinate data and information across every area of their organization, 
the DON aimed its resources at the four major Systems Commands (SYSCOM): 
NAVAIR, NAVSUP, NAVSEA, and SPAWAR. 

The streamlining of Navy business practices emerged from a commercial working 
group adopted in the late 1980s, which eventually led to a large-scale ERP 
implementation at the start of the 21st century. Pour initial pilot programs merged into 
one solution, and GAO recommended a more in-depth oversight of ERP by DON 
Eeadership. Some in Congress say the pilot programs failed; however, research suggests 
that ERP would not be where it is today without the lessons learned from these pilot 
programs. In 2007, ERP was broken down by templates, giving each release number a 
functionality to be responsible for. With each new release, new users were added with the 
implementation process. Projections were made for the cost of implementation with 
estimates totaling $2.4 billion over a 20-year period (PY04-PY23). Projections such as 
this ignite questions as to whether the Navy will see a return on its $2.4 billion 
investment. This project examined the DON’s expected ROI from its original ERP 
implementation. Comparisons were made between the DON’s ROI and that of the private 
sector to analyze the degrees of success between the two entities. 
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B. PRIMARY RESEARCH QUESTIONS 


Has implementing ERP provided the DON with a current positive ROI at the 
end of FY10? If not, will the ERP provide the DON with a positive forecasted 
ROI hy the end ofFYIS? 

ERP is still in the stages of development and deployment within the DON. After 
collecting the data, the actual benefits and actual costs to date were normali z ed to FY04 
dollars. The forecasted benefits and costs were normalized to the same base year. 
Through ROI calculations of one actual and one forecasted ROI, it was determined that 
the actual ROI for the Navy’s ERP program from FY04 to FYIO is -84.46. The 
forecasted ROI for the Navy’s ERP Program from FYII to FYI5 is 208.29, and the 
combined ROI for the Navy’s ERP Program from FY04 to FYI5 is 16.77. The benefits 
were derived from legacy system retirement, inventory reductions held by the DON, and 
labor reductions. All of the Navy’s ROIs are better than those seen in the private sector. 
Calculations were made for actual, forecasted and combined. Three calculations were 
performed because most of the costs to implement an ERP are upfront, and most benefits 
are not realized for years to come. Each calculation shows how the ROI changes over 
time. 


C. SECONDARY RESEARCH QUESTIONS 

How do the actual ROI and the forecasted ROI compare to those of private 
sectors? Were there any nonmonetary benefits not considered in the 
calculation? 

After researching and analyzing the ROI of private sector firms’ ERPs, it was 
discovered that the Navy produced a better return overall. The companies we examined 
that had adopted ERP had an ROI of 8.576 over the average of three years. We concluded 
that ERP implementation provides managers the ability to look into their companies’ 
progress or declination. ERP adoption gives managers the opportunity to make better 
decisions through analysis of alternatives. Once ERP is implemented and employees are 
trained on the system, it has a positive impact on an organization’s utilization of assets. 
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The intangible benefits of ROI were difficult to measure. ERP nonmonetary 
assets, such as information visibility, improved processes, customer responsiveness, 
integration, standardization, globalization, flexibility, and responsiveness, were not 
calculated in the ROI. These elements are not accounted for, but we believe they should 
be considered a valuable asset in the ERP process. 

D. CONCLUSION 

Our thesis conducted research of the evolution of ERP, provided a thorough 
literature review, developed a definition of ROI used by technology projects, and 
presented the ROI experienced by private companies implementing ERP systems. We 
collected data from members of the ERP Program Office and analyzed the cost and 
benefit data of implementing the DON’s ERP. Our intention was to normali z e the data 
and convert all financial information to PY04 dollars, the year the program began. 
Converting the financial cost and benefit data to a common base year was required in our 
work. Our analysis compared the DON actual and projected ROI achieved from PY04 to 
PY15 to that of the commercial sectors. The positive ROI potential from the DON’s ERP 
Program could potentially save the Navy millions of dollars in the long term. There is a 
value in proceeding with the DON’s ERP Program. The majority of the benefits are in the 
future, so a delay of any type, or program termination, will risk losing this future return. 

E. IMPLICATIONS OF THESIS 

After conducting our research on the history of DON’S ERP and its 
implementation, our questions led us to ask why this program is so important and what 
kind of return can be expected from investments in ERPs. There is plenty of information 
surrounding ERP and what it is capable of producing; however, there are also many 
observations on companies losing money with implementation of ERPs. Therefore, the 
question “why would one want to invest in such a program?” is inevitable. Our 
conclusions consistently point to the need for persistence. ERP success requires long¬ 
term resolve. If organizations, such as DON, are willing to invest and endure the 

challenges of applying this program, the payoffs and benefits could have tremendous 
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value. Even if the benefits of Navy ERP reached 50% of their projected target from 
2004-2015, they would still achieve significant long-term benefits. Stretching these 
benefits out to 2023 could potentially increase these figures. 

F. RECOMMENDATIONS FOR FUTURE STUDY 

This report was limited by the data available. Currently, only cost and benefit data 
for FY04 to EYIO are available. Nonmonetary benefits were not included. Future studies 
could build on this report by examining the nonmonetary benefits associated with the 
DON’S ERP Program and devising a method of conversion to a monetary figure that 
could be included in the ROI equation. This report was also limited by the fact that the 
DON’S ERP Program is not fully implemented. We recommend repeating this study after 
the ERP Program has been fully deployed for three years. Doing this would allow for a 
direct comparison of the private sector ROIs the Hunton, Eippincott, and Reck study 
discussed. An ROI for the DON’s ERP program should also be calculated at the end of 
FY23, so a return for the entire program can be determined. All of the data would be 
useful to determine whether the DON’s ERP Program was a success. 
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